---
title: Chunkers Overview
sidebarTitle: Overview
description: Overview of the different chunkers available in Chonkie
icon: "list"
iconType: "solid"
---

Chonkie provides multiple chunking strategies to handle different text processing needs. Each chunker in Chonkie is designed to follow the same core principles outlined in the [concepts](/common/concepts) page.

<CardGroup cols={2}>
  <Card title="TokenChunker" icon="scissors" href="/oss/chunkers/token-chunker">
    Splits text into fixed-size token chunks. Best for maintaining consistent
    chunk sizes and working with token-based models.
  </Card>
  <Card
    title="SentenceChunker"
    icon="align-left"
    href="/oss/chunkers/sentence-chunker"
  >
    Splits text at sentence boundaries. Perfect for maintaining semantic
    completeness at the sentence level.
  </Card>
  <Card
    title="RecursiveChunker"
    icon="chart-tree-map"
    href="/oss/chunkers/recursive-chunker"
  >
    Recursively chunks documents into smaller chunks. Best for long documents
    with well-defined structure.
  </Card>
  <Card
    title="SemanticChunker"
    icon="magnet"
    href="/oss/chunkers/semantic-chunker"
  >
    Groups content based on semantic similarity. Best for preserving context and
    topical coherence.
  </Card>
  <Card title="LateChunker" icon="clock" href="/oss/chunkers/late-chunker">
    Chunks using Late Chunking algorithm, best for higher recall in your RAG
    applications.
  </Card>
  <Card title="CodeChunker" icon="laptop" href="/oss/chunkers/code-chunker">
    Splits code based on its structure using ASTs. Ideal for chunking source
    code files.
  </Card>
  <Card title="NeuralChunker" icon="brain" href="/oss/chunkers/neural-chunker">
    Uses a fine-tuned BERT model to split text based on semantic shifts. Great
    for topic-coherent chunks.
  </Card>
  <Card
    title="SlumberChunker"
    icon="wand-magic-sparkles"
    href="/oss/chunkers/slumber-chunker"
  >
    Agentic chunking using generative models (LLMs) via the Genie interface for
    S-tier chunk quality. 🦛🧞
  </Card>
  <Card
    title="TableChunker"
    icon="table-cells"
    href="/oss/chunkers/table-chunker"
  >
    Splits large markdown tables into smaller, manageable chunks by row,
    preserving headers. Great for tabular data in RAG and LLM pipelines.
  </Card>
</CardGroup>

## Availability

Different chunkers are available depending on your installation:

| Chunker          |                        Default                         |                       embeddings                       |                    `"chonkie[all]"`                    |                   Chonkie JS                    |                          API Chunking                           |
| ---------------- | :----------------------------------------------------: | :----------------------------------------------------: | :----------------------------------------------------: | :----------------------------------------------------: | :----------------------------------------------------: |
| TokenChunker     | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> |
| SentenceChunker  | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> |
| RecursiveChunker | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> |
| TableChunker     | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> |
| CodeChunker      |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> |
| SemanticChunker  |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> |
| LateChunker      |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> |
| NeuralChunker    |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> |
| SlumberChunker   |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> | <Icon icon="check" color="#005c00" iconType="solid" /> |   <Icon icon="x" color="#ff0000" iconType="solid" />   | <Icon icon="check" color="#005c00" iconType="solid" /> |

## Common Interface

All chunkers share a consistent interface:

<CodeGroup>
```python Python
# Single text chunking
chunks = chunker.chunk(text)

# Batch processing
chunks = chunker.chunk_batch(texts)

# Direct calling
chunks = chunker(text)  # or chunker([text1, text2])
```

```javascript JavaScript
// Single text chunking
const chunks = await chunker.chunk(text);
```

</CodeGroup>

## F.A.Q.

<AccordionGroup>
  <Accordion title="Are all the chunkers thread-safe?" icon="reel">
    Yes, all the chunkers are thread-safe. Though, the performance might vary
    since some chunkers use threading under the hood. So, monitor your
    performance accordingly.
  </Accordion>
</AccordionGroup>
